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Voice Instant Messaging 

Tnis application claims fee benefit of LIS.. Provisional Application Mo. 6Q/H9S74 
filed March .1?, 2000 and U.S. Provisional Application No. 60/239,91? Sled October 13, 
2000. 

TECHMC.iL FIELD 
'Hie present invention relates generally to transferring data between subscribers of a 
communications system and more particularly to transferring audio data between subscribe 
of an instant naessaging host, 

BACIC0R01OT 

Online service providers are constantly offering new services and upgrading existing 
services to enhance their subscribers' online experience. Subscribers have on-demand access 
to news, weather, financial, sports, and entertainment services as well as fee ability to 
transmit electronic messages and to participate m online discussion groups. For example, 
subscribers of online service providers such as America Online or CompuServe may view 
and retrieve kuormation on a wide variety of topics irom servers located throughout the 
world. A server may be maintained by the service provider or by & third party provider who 
makes information and sendees available through tire worldwide network of computers feat 
make up the online service. 

America Online has provided subscribers with the ability to send and receive rastanl 
messages. Instant messages are private online conversations between two or more people 
who have subscribed to the instant messaging sendee and have installed the necessary 
software. Because such online conversations take place in essentially real time, instant 
messaging can provide immediate access to desired information. Instant messaging is 
becoming a preferred means of communicating among online subscribers. 
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In one general aspect, electronic data is transferred between users of a 
commximc&tiQBS system by enabling mstmi messaging a>rs.mnnicatios between a sender an 
at least one recipient through an irjstant messaging host In addition, voice ceimmmieation is 
S enabled between fee sender and fee recipient through the instant messaging host. 

tomlememations may include one or mere of the following features. For example, 
implementations may include .receiving and authenticating a text imstar-t message from the 
render at the instant messaging host; detenmning capabilities of the recipient reporting the 
capabilities of the recipient; receiving a request to establish voice coramtinicstios. fern fee 
10 sender sad/or the recipient; and/or au&anticaiing the request Au&eniieating may include 
iden.rifyi.ng a screen name and'or act II* address of the sender and/or fee recipient 
Deteimkdng capabilities of fee recipient may include identifying hardware or software 
associated with the recipient. A user interface may be displayed according to the capabilities 
of the recipient. 

18 Voice eornmurricatie-n naay be enabled by establishing a generic signaling interface 

channel, a control charge!, and an aadio channel between the s^ndar and the recipient 
A mode UDP test may be attempted on the audio channel The control channel may include 
a TCP/IP socket. The audio channel may include a VUP or TCP channel 

These and other general aspects may be implemented by an apparatus and/or by a 
20 computer program stored on a computer readable medium. 'Die computer readable medium 
may comprise a disc, a client device, a host device^ and/or a propagated signal 

Other features and advantages will be apparent from fee following description, 
including the drawings, arid from the claims. 

BESCMFHON OF THE BRAWXNGS 

Fig. 1 is a block diagram of a conununications system. 
Figs. 2-5 arc expansions of the block diagram of "Fig. I . 

Fig, 6' is a flow chart of a communications method that may be implemented by the 
systems of Figs. 1-5. 

38 Figs. 7-10 are illustrations of different graphical user interfaces that may be provided 

by the systems of Figs. 1-5. 
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DETAILED DESCRXFTION 

.For Hks&stxve purposes, Figs. 1-5 describe a eormnufnc^tious system for 
implementing techniques for transfetring electronic data. Per brevity, several elements is the 
figures described below ate represented as monoii&ie entities. However, as would fee 
§ understood by one skilled in the art, these elements each, may include numerous 

interconnected computers arid components designed to perform a set of specified operations 
and/or dedicated to a particular geographical region. 

Referring to .Big. L a communications system 100 is capable of delivering and 
exchanging data between a client system 105 and a host system 1 10 through a 

10 communications link - 1 .1 S. The client system 105 typically includes erne or more client 

devices .120 and/or client controllers 125. For example, the client system 1 05 may include 
erne or more general-purpose computers (e.g.., personal computers), one or more special- 
purpose computers (e.g.. devices specifically programmed to cornnrouieate with each other 
and/or the host system 1 10), or a combination of one or more geaensi -purpose computers arm 

ia one or more special-purpose computers. The client system 105 may be arranged to operate 
within or in concert with one or more other systems, such, as for example, one or more LANs 
{"Local Area Networks") and/or one or more WANs {"Wide Area Networks"). 

The client device 120 is generally capable of executing instructions under the 
command of a cheat controller 125. The client device 120 is connected to the client 

20 controller 125 by a wired or wireless data pathway 130 capable of delivering data. 

The client device 1 20 and client controller 1 25 each typically includes one or more 
hardware components and/or software components. An example of a client device 120 is a 
general-purpose- computer (e.g.. a personal cot&mtes} capable of responding to aad executing 
tnstmctions in a deSned manner. Other examples include a special-purpose computer, a 

2§ workstation, a server, a device, a component, other equipment or some combination thereof 
capable of responding to aad executing attractions. An example of client controller 125 is a 
software application loaded on the client device 120 for coramaadmg aad directing 
coounmucations enabled by ihe client device 120. Other examples include a program, a 
piece of code, an instruction, a device, a computer, a cojnputer system, or a combination 

30 thereof, for independently or collectively uistructiag the client device 120 to interact and 
operate as described herein. Ifee client coatrollex 125 may fee embodied permanently or 
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temporarily in any type of machine, component equipment,, storage medium, or propagated 
signal capable of providing .bstrncdoiss to the client devise J 28. 

The communications link 115 typically includes a delivery network .160 making a 
direct or Indirect crnimvunieation between the client system 105 and the host system 110, 
S irrespective of physical separation. Examples of a delivery set work IdO include the Internet, 
the World Wide Web, WANs, LANs, analog or digital wired and wireless telephone 
networks (e,g. PSTN, ISDN, or xDSL), radio, television, cable, satellite, arid/ or any other 
delivery mechanism for carrying data. The eommuaications link 115 may induds 
communication pathways .1 SO, 1 55 that enable eommunieatioas throitgh the one or mors 

is delivery networks 1 60 described shove. Each of the comm\rhcation pathways 1 50, 155 may 
include, for example, a wired, wireless, cable or satellite commutation pathway. 

The host system • 10 includes a hast device 135 capable of executing instructions 
under the command and direction of a host controller 140, The host device 135 is connected 
to the host controller 140 by a wired or wireless data pathway 1 45 capable of carrying and 

is delivering data, 

I"he host system 1 10 typically includes one or more host devices 135 and/or host, 
controllers .1 40. For example, the host system 1 10 may include one or more general-purpose 
computers (e.g., personal computers), one or more special-purpose computers (eg., devices 
specifically prcgrainmed to eommumeais wife each other and/ox fee client system 105), ox a 

SS combination of one or more general-purpose computers and one or more special-purpose 

computers. Tire host system 1 10 may be arranged to operate within or in concert with one or 
more other systems, such as. ; for example, one or more LANs ("local Area Networks") 
and/or one or more WANs ("Wide Area .Networks"). 

The host device 135 and host controller 140 each typically includes one or more 

as hardware components aad/or software components. An example of a host device 1 3 5 is a 

general-purpose computer (eg., a personal computer) capable of responding to and scouting 
imitnretions in a defined mariner, Other examples inemde a special-purpose computer, a 
workstation, a server, a device, a component, other equipment or some coxnbination thereof 
capable of responding to and executing instructions. An example of host controller HO is a 

SO software application loaded on fee host device D5 for commanding and directing 

commtrmcarions enabled by the host device 135, Other examples include a program, a piece 
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of code, sr. instruction, a device, a computer, a computer system, or a combination thereof, 
for independently or collectively instructing the hose device 135 to interact and operate as 
described henein. The host controller 140 may be embodied permanently or tetsporaiiiy la 
any type of machine, component, equipment, storage medium, or propagated signal capable 
s of providing instructions to the host device 135. 

Fig, 2 illustrates a communication system 200 including a client system 205 
cosimusicating with a .host system 210 through a eoinmaoicarions. link 215. Client system 
205 typically includes on& or more client devices 220 and one or more client controllers 225 
for controlling the client devices 220, Host system 210 typically includes one or more host 

10 devices 235 and one or more host controllers 240 for controlling fee host devices 235. The 
connnmicarions link 215 .may Include commiuiicadoapathvvsys 2.50. 255 enabling 
eormnuniearions through the one or more delivery networks 260. 

Examples of each element within the communicadoa system of Fig. 2 are broadly 
described above with respect to Fig, L In particular, the host system 210 and 

1S coramunications link 2 i 5 typically have attributes comparable to those described with 
respect to .host system .1 \ 0 and communications link 1 1 5 of Fig. 1. Likewise, the client 
system 205 of Fig. 2 typically has attributes comparable to and illustrates one possible 
embodiment of the client system ICS of Fig. 1, 

Hie client device 220 typically includes a general purpose computer 2/0 having an 

20 internal or external storage 272 for storing data and programs such as an operating system 
274 (e.g., DOS, Windows™, Windows 95™, Windows 98™, Windows 2000™, Windows 
NT™, OS/2, or Linux) and one or more application programs. Examples of application 
programs include authoring applications 276 (e.g., word processing, database programs, 
spreadsheet programs, or graphics pi-ograms) capable of generating documents or other 

as electronic content; client applications 278 (e.g., AOL client, CompuServe client, AIM client, 
AOL TV client, or ISP client) capable of oommimicating wife other computer users, 
accessing various computer resources, and viewing, creating, or otherwise marnpiuating 
electronic content; and browser applications 280 (e.g., Netscape's Navigator or Microsoft's 
Internet Explorer ) capable of rendering standard internet content 

The general-purpose computer 270 also includes a central processing unit. 282 {CPU} 
for executing instructions in response to commands ftom the clieut controller 225. In one 
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implementation, the client controller 225 includes one or more of the application programs 
installed on the iatsmd. or external storage 272 of the general-purpose computer 270. fo 
another implementation, fee client controller 223 includes application proems externally 
stored in and performed by one or more devieefs) external to the general- purpose computer 
5 270. 

The general-purpose computer typisally will include a eornmtmie^tion device 284 for 
sending and receiving data., One example of the communication device 2S4 is a modem. 
Other examples Include a transceiver, a set-top box, a communication card, a satellite dish, 
an antenna, or another network adapter capable of transmitting and receiving data over the 

?» communications link 21.5 through a wed or -wireless data pathway 250. The general- 
purpose computer 270 also may include a TV {"television"} tuner 286 for receiving television 
programming is the form of broadcast, satellite, and/or cable TV signals. As a result the 
client device 22D can selectively and/or simultaneously display network content received by 
conunumc^tions device 284 arid television programming content received by the TV tuner 

1S 286. 

The general -purpose computer 270 typically will include as kput/ontput interface 
28$ for vvired or wireless connection to various peripheral devices 290. Examples of 
peripheral devices 290 include, but are not limited to, a mouse 291, a mobile pfecme 292 s a 
personal digital assistant 293 (FDA), a keyboard 294, & display monitor 295 with or without 

20 a touch screen input, a TV remote control 296 &r receiving Monuatisn from and rendering 
information to subscribers, and a video input device 298. 

Although Fig. 2 iUastratea devices such as a mobile telephone 292, a PDA. 293, and a 
TV remote control 296 as being peripheral with respect to the general-purpose computer 270, 
In another implementation, such devices may themselves include the ibnctionaUty of the 

2S general-purpose computet 270 and operate as the client device 220, For example, fee mobile 
phone 292 or the FDA 293 may include computing and networking capabilities and function- 
as a client device '220 by accessing fee delivery network 260 and communicating with the 
host, system 210. Furthermore, the client system 205 may include one, some or all of the 
components and devices described above. 

SB Referring to Fig. 3, a communications system 300 is capable of delivering arid 

exchanging information between a client system 303 and a host system 310 through a 
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communication link 315, Clier.it system 305 typically includes one or more client devices 
320 and one or more client controllers 325 for controlling fee client devices 320. Host 
system 3 1 0 typically includes one or snore host devices 335 arid one or more host controllers 
340 for controlling lbs best devices 335. The conminnicahons link 315 may include 
§ communication pathways 350, 355 enabling cosasroaicatio&s through the one or more 
delivery networks 360, 

Examples of each element within the communication system of Fig. 3 are broadly 
describee- above with respect to Figs. 1 sad 2, In particular, fee client system 305 and the 
communications link 3.15 typically have attributes comparable is those described with 
is respect to client systems 105 and 205 and conixnimicatioas links 115 and 2.1 5 of Figs. .1 end 
2. Likewise, the host system 310 of Fig. 3 may have attributes comparable to and illustrates 
one possible embodiment of the host systems 110 and 210 shown in Figs. 1 and 2, 
respectively. 

Hie host system 3 1 0 includes a host device- 335 and a host controller 340, The host 

is controller 340 is generally capable of transmitting nistructions to my or all of the elements of 
the host device 335, For example, b one implementations the host controller 340 includes 
oae or more software applications loaded on the host device 335. However, ta other 
implementations., as described above,. the host controller 340 may include any of several 
other programs, machines, aad devices operating independently or collectively to control me 

20 host device 335, 

The host device 335 includes a login server 370 for enabling access by subscribers 
and routing connnunioations between the client system 305 a&d other elements of the host 
device 335, The host devise 335 also includes various host complexes such as; the depicted 
OS? ("Online Service Provider") host complex 380 and IM ("Instant Messaging") host 

2$ complex 390, To enable access to these .host, complexes by subscribers, the client system 305 
includes communication software, for example, an OS? client application and an IM client 
application. The OS? and IM eortmaunieahon software applications are designed to facilitate 
the subscriber's iuter&ctio&s with the respective services aod. In particular, may provide 
access to ail me services available withm the respective host complexes, 

s& Typically, the OS? host complex BSC supports different services, such as am.&il> 

discussion groups, chat, news services, and Internet access. The OSPhnst complex 3 SO is 
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generally designed with an architecture (fast enables the machines \vithia the OSP host 
complex 3 BO to commimicate with ea&h other and employs certain protocols <ie,, standards, 
formats, conventions, rules, and smxctnres) to ttaasfer data. The OSP host complex 3 SO 
ordinarily employs one ox' more OSP protocols and custom dialing engines to enable access 
S by selected client application. The OSP host complex 380 say define one or more specific 
protocols for each service based on a common, underlying proprietary protocol 

The IMhost complex 390 is generally independent of fee OSP host complex 380, and 
supports instant messaging services irraspeetlve of a subscriber's network or Internet access. 
Thus, the !M host complex 390 allows subscribers to send and receive Instant messages, 

10 whether or not they have access to any particular ISP, The hM host complex 390 may 

support associated services, such, as administrative matters, advertising, directory sendees, 
chat, and interest groins related to the hwt&ni messaging. The !M host complex 390 has an 
architecture that enables all of the machines within the IM host complex to eomniuuie&ie 
with each other. To transfer data, the IM host complex 390 employs one or mora standard or 

15 exclusive IM protocols. 

The host device 335 may inelnde one or more gateways that connect and therefore 
link- complexes, such as the OSP host complex gateway 3 US and die IM host, complex 
gateway 395, The OSP host complex gateway 385 and the US'! host complex 395 gateway 
may directly or indirectly link the OSP host complex 380 with fee IM host complex 390 

20 through a wired or -wireless pathway. Ordinarily, when used to facilitate a link between 
complexes, the OSP hoist complex gateway 385 arid fee IM host complex gateway 395 are 
privy to information regarding the protocol type anticipated by a destination complex, which 
enables any necessary protocol conversion to be performed incident to the transfer of data 
.from one complex to another. For instar.ee, the OSP host complex 3 SO and. IM host complex. 

25 390 generally use different protocols such that transxerrmg data between the complexes 
requires protocol conversion by or at fee request of the OSP host complex gateway 3S3 
and/or the M host complex, gateway 395. 

Referring to Pig, 4, a eornmunlearlora? system 400 is capable of delivering and 
exchanging herniation between a client system 495 and a host system 410 through a 

30 commuaicadon. link. 41 S. Client system 403 typically includes one or more client devices 
420 and one or more client controllers 425 for controlling the client devices 420, Host 


system 410 typically includes one or more host devices 435 and one or more best controllers 
440 lot controlling the host devices 435. The commuaicsiions link 415 may include 
coimmmKaiien pathways 450, 455 enabling eommume-ations through fee one or more 
delivery networks 460. As shown, the client system 405 may access the Internet 465 through 
S the host system 410, 

Examples of each defeat wi&ic the eorra^udeadon system of Fig. 4 are broadly 
described above with respect to Figs. !~3. m particular, the clieat system 40S sod the 
commutations link 415 typically have attributes comparable to those described with 
respect to clieat systems 105, 205, and 30S and commimicatiens folks US, 215, and 315 of 

10 Figs. 1-3. Likewise, the host system 4 1 0 of Fig, 4 may have attributes comparable to sad 

ilbsstrat.es one possible embodiment of the host systems 1 10, 2 1 0, and 3 ! 0 shown in Figs. I - 
3, respectively, However, Fig, 4 describes an aspect of the host system 41 0, focosing 
primarily on one particular implementation of OSP host complex 4 SO, for purposes of 
coatmtmicating with sa OSP host complex 4S0, fee delivery network 46» is generally a 

16 ts.lep.hoao network, 

The cheat system 405 includes a client devise 420 and a client controller 425. The 
client controller 425 is generally capable of establishing a connection to the host system 410, 
including the OSP host complex 480, the IM host complex 490 aad'or the .Internet 465. hi 
one implementation, the client controller 425 includes aa OS? appiizzdioa for conimanic&ting 

20 with servers in the OSP .host complex 430 using exclusive OSP protocols. The client 

controller 425 also may include application such as aa XM client application, and/or aa 
Internet browser application, for coauaunkstmg with the XM host complex 490 and the 

The host system 410 includes a host device 435 and a host controller 440. The host 
25 controller 440 is generally capable of transmitting instructions to any or all of the elements of 
fee host device 435. For example, in one implementation, the host controller 440 includes 
one or more software applications loaded oa one or mare elements of the host device 435. 
However, in other implementations, as described above, fee host controller 440 may include 
any of several other programs, machines, and devices operating independenOy or collectively 
30 to control the host device 435. 
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'lbs? OSP host complex 4S0 also includes & proxy server 4806 for directing data 
requests and/or otherwise facilitating conmtnnieation between the client system 405 and fee 
Internet 465 through, "the proxy server 4802 may include an J? ('Internet Protocol 85 ) tunnel 
for converting data from OSP protocol into standard Internet protocol and transmitting the 
data to the Internet 465, The IP tnnnei also converts data received .from the Internet in the 
etandas'd Internet protocol hack into fee OSP protocol and sends she converted data to the 
roiiting processor 4802 for delivery hack to fee client system 405, 

Hie proxy server 4806 also may allow tire client system 405 to use standard Internet 
protocols arid formatting to access the OSP host complex 480 and the Internet 465. For 
example, the subscriber can use an OSP TV client application having an. embedded browser 
application installed on the client system 405 to generate a request in standard Internet 
protocol, such as HTTP CHypesText Transport Protocol"). In a packet-based 
implementatiou, data packets may be encapsulated inside a standard Internet tunneling 
protocol, such as, for example, i)BP ("User Datagram Protocol") and routed to the proxy 
server 4806. Hie proxy server 4806 may Include a E2TP ("Layer Two Ttmnehog Protocol") 
tunnel capable of establishing a point-to-point protocol (PPP) session wife the client system 
405. 

The proxy server 4806 also may act as a buffer between the client system 405 and the 
Internet 465, and may implement content filtering and tune saving techniques. For example, 
fee proxy server 4806 can check parental controls settings of the client system 405 and 
request and transmit content iroto the Internet 465 according to the parental control settings. 
In addition, fee proxy server 4806 may Include one or more caches for storing .feqnently 
accessed informatiom If requested data is determined to be stored in ihe caches, the proxy 
server 4866 may send fee kvtbrtnation to the client system 405 from fee caches and avoid the 
need to access the Internet 465. 

Referring to Fig. 5, a comnunucations system 500 is capable of delfvsring and 
exchanging infonrratlon between a client system 505 and a host system 510 through a. 
communication link 515, Client system 505 typically Secludes one or more client devices 
520 and one or more client controllers 525 for controlling the client devices 520. Host 
system 510 typieaUy includes one or more host devices 535 and one or tnore host controllers 
540 for conlxollifig fee host devices 535, U» mwmska^m ink 515 may include 
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communication pathways 550, 555 enabling conununieatlons through the ons or more 
delivery networks 56ft. As shown, the client system SOS may access the Internet 565 through 
the host system 510. 

Examples of each element within Hie eonnnuiueatioii system of Fig. 5 are broadly 
S described above wife respect to Figs. i~4. m particular, the client system 505 and the 
connmmioaiions link 515 typically have attributes comparable to those described with 
respect to client systems 105, 205,. 305 , arid 405 and commnnications links 1 15 f 215, 315, 
and 41 5 of Figs. 1-4, Likewise., the host system 510 of Fig, 5 may have attributes 
comparable to arid illustrates one possible embodiment of the host systems 1 10, 21 0, 31 0, 

18 gad 41 0 shows is Figs. 1-4, respectively. However, Fig. 5 describes an aspect of the host 
system 51 0, focusing primarily on one particular implementation of EM host complex 590. 
For purposes of communicating with the 1M host complex 590, fee delivery network 560 is 
generally a telephone network. 

The client system 505 includes a client device 520 and a client controller 525. The 

15 client controller 525 Is generally capable of establishing a connection to the host system 510. 
ioeinding the OSP host complex 580, the EM host complex 590 and/or the Internet 565, In 
one implementation, the client controller 525 includes an 1M application for eorsmumeaiing 
with servers in the IM host complex 590 milhdng exclusive XM protocols. The client 
controller 525 also may include applications, such as an OSP client application, and/or as 

20 Internet browser application .for commuokating with the OSP host complex 5 SO and the 
Internet 565, respectively. 

The host system 510 includes a host device 535 and a host controller 540, The host 
controller 540 is generally capable of transmitting instructions to any or all of the elements of 
fee host device 535, For example, in one implementation, the host controller 540 includes 

2§ one or more software applications loaded on one or more element of the host device 535, 
However, in other implementatioas, as described above, fee host controller 540 may include 
any of several other programs, machines, and devices operating independently or collectively 
to control the best device 535, 

The host system SiO includes a login server 570 capable of enabling commmnoations 

30 with and authorising access by client systems 505 to various elements of the host system 520, 
Including an OSP host complex 580 sad an IM host complex 590, The login server 570 may 
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implement one or .more authorization procedures to enable simultaneous access to fee DSP 
host complex 380 sad the M host complex 590. Ilw OSP host complex 580 and the IM host, 
complex S90 are connected through one or mora OST host complex gateways 5S5 and one or 
more IM host complex gateways 595, Bach OSP host complex gateway 585 and IM host 
§ complex gateway 595 may perform any protocol conversions necessary to enable 

comtnunk-atioa between the OSP host complex 580, the IM host complex 590> and the 
Internet 563. 

To access the host complex 590 to hops an instant oiessaging session, the client 
system 505 establishes a aiuuectior- to the login server 570. The login, serves- 570 typically 

10 determines whether the particular subscriber is authorized to access the IM host complex 590 
by verifying & subscriber identification and password. If the subscriber is authorized to 
access fee IM host complex 598, fee login server 570 employs a hashing technique on the 
subscriber's screen name to identify a particular I'M server 5902 tor use during the 
subscriber's session. The login server 570 provides the client system 305 with fee IP address 

is of fee particular IM server 5902 4 gives the client system 505 an encrypted fey {Le, s & cookie), 
and breaks trie connection. Hie client system 505 then uses the IP address to establish a 
connection to the particular IM server 5902 through fee conunnakations link. 515, and 
obtains access to that IM server 5902 using fee encrypted key, Typically, the client system 
505 will be equipped with a Wiusock API ("Application Programming Interface") feat 

20 enables the client system 505 to establish an open TCP connection to the IM server 5902. 

Once a connection to fee IM server 5902 bas been established, the client system 505 
may directly or indirectly transmit data to and access content from fee IM server 5902 and 
one or more associated domain servers 5904. lite IM server 5902 supports fee fundamental 
instant messaging services and the domain servers 5904 may support associated services, 

as such as, for example, adaur%trative matters, directory service, , chat and interest groups. In 
general, She purpose of the domain servers 5904 is to lighten the load placed on the XM server 
5902 by assnnxuig responsibility for some of fee services within the IM host complex 590. 
By accessing fee XM server 5902 and/or fee domain server 3904, a subscriber can use tha IM 
client application, to view whether particular subscribers ("buddies") nre online, exchange 

30 imtssnt messages with particular subscribers, participate in group chat rooms, n-ade files such 
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as pictures;, invitations or documents, fed other subscribers with similar interests, get 
customised news and stock quotes, and search fee Web, 

In the implementation of Fig. 5, the IM server 5902 is directly or indirectly ejected 
to a mating gateway 5906. The routing gateway 5906 facilitates the connection between fee 
§ mi server 5902 and one or more alert multiplexors 590S, for example, by scnraag as a link 
taiaimffiato tool or bub to connect several IM servers to several alert multiplexors, fa 
general, an alert multiplexor 5908 maintains a record of alerts and subscribers registered to 
receive the starts. 

Once the client system 505 is connected to fee atert multiplexor 5908, a subscriber 
10 can register for and/ car receive one or snare types of ate. The connection pathway between 
the client system SOS and the alert .multiplexor 5908 is detersiiaed by employing aao&er 
hashmg tecMque at the IM server 5902 to ideality the particular alert multiplexor 5908 to be 
used for the subscriber's session. Once the particular multiplexor 5908 has been identified, 
the XM server 5902 provides fee client system 505 with the IP address of the particular alert 
1S multiplexor 5908 and gives the client system 505 an encrypted key (i.e., a cookie). The 

client system 505 men uses the IP address to connect to the particular alert multiplexor 5908 
through the corrmiimicaiion link 5.1 5 and obtains access to fee alert multiplexor 5908 using 
the encrypted key. 

The alert multiplexor 5908 is connected to m alert gate 59.1 0 that, like the IM host 
complex gateway 595, is capable of performing the necessary protocol conversions to tons a 
bridge to the OSP .host complex 580. The alert gate 5910 is the interface between fee IM 
host complex 590 and the physical servers, such as servers in the OSP host complex 580, 
where state changes are ocemring. In general, the info.rmat.iou regarding state changes will 
he gathered and used by the IM host complex. 590. However, the alert multiplexor 5908 also 

as may communicate with the OSP host complex 5§0 through the M gateway 595, tor example, 
to provide the servers and subscribers of the OSP host complex 580 with certain informatics 
gathered torn fee alert gate 5910. 

The alert gate 5910 can detect m alert feed corresponding to a particular type of alert; 
The alert gate 5910 may include a piece of code (alert receive code) capable of interacting 

3S wife another piece of code (alert broadcast code) on the physical server where a state change 
occurs, Ih general., the alert receive code installed on fee alert gate 593 0 instructs the alert 


broadcast code installed on the physical server to seud au alert feed to the aim gat© 5910 
upon fee occurrence of a particular state ehaage. Upon detecting sn alert feed, the alert gate 
3910 contacts fee alert mtiitipiexor 5908, which is turn, htforms tbe client system 505 of fee 
detected aim feed. 

In the- kspleaierttation of Fig. 5., fee !M host complex 590 also includes & subscriber 
profile server 591 2 connected to a database 5914 for storing large amounts of subscriber 
profile data. The subscriber profile server 5912 may be used to enter, retrieve, edit, 
manipulate, or otherwise process subscriber profile data. In one implementation, a 
subscriber's profile data includes, for example, fee subscriber's b^ddy list, alert preferences, 
designated stocks, identified interests, and geographic location. The subscriber may enter, 
edit and/or dekte profile data using an installed IM client application or the client system 
5f>5 to interact with fee subscriber profile server 5912. 

Because the subscriber's data, is stored in fee IM host complex 590, the subscriber 
dees not have to reenter or update such information is the event that, the subscriber accesses 
the IM. host complex 590 using new or a different cheat system SOS. Accordingly, -when a 
subscriber accesses fee IM host complex 590, the XM server 5902 can instruct the subscriber 
profile server 591 2 to retrieve the subscriber's profile data from the database 5914 and to 
provide, for example, fee subscribers buddy list to the XM server 5902 and fee subscribers 
alert preferences to fee alert multiplexor 590$. The subscriber profile server 5912 also may 
communicate with other servers in fee OSP host complex 590 io share subscriber profile data 
with other services. Alternatively, user profile data may be saved locally on fee client device 
505, 

Referring to Fig. 6, a sender 602a, a recipient 602b, and a host 604 interact according 
to a procedure 600 to transfer audio data. The procedure 600 may be implemented by any- 
suitable type of hardware, software, devise, computer, computer system, equipment, 
component, program, application, code, storage medium, or propagated signal 

"Examples of each element of Fig. 6 are broadly described above -with respect to Figs. 
1-5. In particular, the sender 602a and the recipient 602b typically have attributes 
comparable to those described with respect to client devices 120, 220, 320, 420, and 520 
aud/or client controllers 1 25, 225, 325, 425, and. 525. The host 604 typkaliy has attributes 
comparable to those described with respect to host device .135, 235, 335, 435, ami 535 and/or 
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host controllers 140> 240, 340, 440, sad 540, The sender 602a, the recipient 602b, and/or the 
host m may he directly or indirectly interconnected through a known or described delivery 

The sender 602a and the recipient 602b are each associated with a subscriber. To 
5 allow He transfers, each subscriber sets certain preferences tor permitting files to he 

transferred to and &om other subscribers. For example, the wander and recipient may identify 
screen names of subscribers who have permission io send fifes to them or retrieve files from 
them. Typically, each subscriber will be presented wife a graphical user interface that 
permits selection among various transfer preferences, A subscriber's transfer preferences 

10 may he maintained locally at fee client or remotely at the host 604. 

In general, fee seeder 6'02a arid fee recipient 602b conrasmicaie cs^ar an open 
ejection, such as an open TCP connection established through the host 604. Typically, the 
sender 602a and fee recipient 602b each include a Wiasoek AH for establishing an open 
TCP connection, to the host 604 and a client application jfar accessing the host 604, The 

15 sender 602a end the .recipient 602b connect to the host 604 to establish the connection. 

The sender 60:2a and the recipient 602b use fee connection to comnwnkate with the 
host 604 and -with each other. The connection remains open during the fene feat the sender 
602a and the recipient 602b are accessing fee host 604, To access the host 604, fee sender 
602a arid fee recipient 602b each send a separate request, to fee host 604. The request 

m- identifies fee associated subscriber to the host 604 and to other subscribers using a unique 
screen name. The host 604 verifies a subscriber's information {e.g„ screen name and 
password) against data stored in a subscriber database. If fee subscribers information is 
verified, the host 604 authorizes access. Hthe subscriber's information is not verified, fee 
host 604 denies access and sends an error message. 

2S Upon accessing the best 604, a "buddy list* is displayed to the subscriber, in general 

a subscriber's buddy list is a user interface feat lists fee online status and capabilities of 
certain screen names, ie„ "buddies", identified the subscriber, In particular, the host 604 
informs fee sender whether identified buddies are online, i.e, currently accessing fee host 
604, The host 604 also informs any subscriber who has identified fee sender as a buddy that 

30 fee sender is currently online. The buddy list also facilitates iastaat messaging 

communication between subscribers. A subscriber can activate an instant messaging 


- 16- 


message user interface pj^addressed to a buddy simply by clicking the screen same of a 
buddy on the buddy list If a recipient is not a "buddy," fee first subscriber must activate a 
blank instant messaging usee interface and then address the instant message to the screen 
name of the intended recipient "When necessary, a subscriber can .look up fee screen name of 
an intended recipient nsmg the Intended recipient's e-mail address. 

Is addition to exchanging instant messages with online buddies, the sender may 
participate m group chat rooms, locate other subscribers with similar interest get 
castomiasBd news sod stock quotes, search the Web. and transfer tiles to and from other 
subscribers, In one implementation, & sender 602a, a recipient 602b, arid a boa 604 interact 
according to a procedure 600 to transfer audio data. 

Hie transfer of audio data extends the naictwnafity of instant massaging by allowing 
fee sender 602a and the .recipient 602b to cCTEnamnicate peer to peer via audio, i.e., 
microphone and speaker. In one hspteentauou, the sender initiates the process 600 by 
designating one or more recipients to receive an instant message (e.g., a text message). If the 
intended recipients are buddies" of fee sender 602a, the sender 602a may confirm the online 
status and capabilities of each recipient prior to sending the video message by viewing the 
"buddy fist" After a subscriber composes an Instant message and dicks a SEND button, fee 
instant message is sent from fee sender 602a to the host (step 60S). 

Alter receiving fee instant message from fee sender 602a, the host 704 authenticates 
fee instant message (step 610). addition to fee textual body, the instant message may 
bdn.de header information identifying the message type, fee screen name and/or IP address 
of toe sender and recipient, and a randomly generated security number. The instant message 
may be authenticated by, for example* using a reverse look-up table to match fee screen 
names and/or IP addresses wife those of valid subscribers. In fee event that either fee sender 
602a or the recipient 602b is not associated with a valid subscriber, fee host 604 reports an 

Once toe instant message is verified, the host 604 detenaines the capabilities of the 
recipient (step 615). For example, fee host 604 may monitor and update the online status, 
client version, and device type of all connected subscribers in real time. The capability to 
receive audio data may depend on hardware (e.g., device type), software (e.g., client 
version), and/or transfer preferences (e,g.,, blocked screen names). To be talk enabled, both 
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fee talk software and audio equipxaeat most be available. The host 604 dim reports the 
capabilities of the .recipient to fee sender (step 620), 

Upon receiving fee report from fee host 604, the sender 602a displays a Ul' according 
to the capabilities of the sender sad/or the recipient ?02b (step 625). If fee sender 602a is not 

{ & talk cabled, then a standard iastast messaging user interface is displayed. If fee seeder 602a 
is talk enabled, but. the recipient 602b is act talk enabled, a START TALK UI having a 
grayed START TALK button is displayed. If both the sender 602a and the recipient 602b are 
talk enabled, a START TALK UI having a ironing START TALK button is displayed. 
The process 600 continues with fee host 604 sending fee mststat message to fee 

10 recipient 602b (step €30). The recipient 602b accepts tbe initial text message from the host 
604 (step 635) and displays a UI according to the capabilities of the sender 602a and/or the 
recipient 602b (step 640), if the recipient 602b is not talk enabled, then a standard instant 
messaging OX is displayed. If the recipient 602b is talk enabled, but the sender 602a is not 
talk enabled, an instant messaging 111 having a grayed START TALK button is displayed. If 

IS both fee recipient 602b and fee sender 602a are talk enabled, an instant messaging 111 with a 
functioning START TALK button is displayed. 

If both sides ate talk enabled, both fee sender 602a and the recipient 602b have a 
START TALK UI displayed. When fee START TALK UI is displayed, a subscriber can 
initiate a talk session. In one implementation, fee sender 602a initiates a talk session by 

20 sending a talk request to the host 604 (step 645), Tbe talk request may contain bsfcrmation 
including, bat not limited to, the message type, the screen name and/or IF address of the 
sender and recipient, and a randomly generated security number. When a tbe sender 60:2a 
clicks fee START TALK Ul, the START TALK 01 nations to an END TALK UI 

Upon receiving the talk, request, fee host 604 authenticates the talk request trora fee 

as sender 602a (step 650). The host 604 may authenticate the talk request by, for example, 
using a reverse look-up table to match the screen names and/or IP addresses with these of 
valid subscribers. In the event that either the sender 602a or the recipient 602b is not 
associated wife a valid subscriber, fee host 604 reports an error message. 

After verifying the talk request, the host 604 sends the talk request to the recipient 

3S 602b (step 655). Upon receiving the talk request, fee START TALK. Ul displayed by the 
recipient 620b transitions to a CONNECT UI (step 660). The CONNECT UI informs fee 


recipient 602b that the sender 602a wants to engage in a talk session. At tills point, the 
recipient 602b may igaere the talk request, accept the talk request, or temuoate the instant 

If fcs recipient 602b accepts fee talk request by clicking the CONNECT W (step 
I 665), the COHKBCT UI tsmm&m to fee END TALK Ul and the host. 604 establishes a talk 
session (step 670). 'When a talk session is active, users am talk to each other- At this point, 
END TALK Ul is displayed by both the sender 602a and fee recipient 60.2b. The talk session 
(steps 675*4) remains acti ve until one of the users clicks END TALK Ul Met one of the 
users dicks the END TALK UI, both fee seadar 602a and the recipient 602b will display fee 

18 START TALK UI, sHowing either side to initiate yet another talk session. 

If the sender 602a disengages ftom tie talk session before the recipient connects, the 
CONNECT UI at the recipient 602b transitions hack to fee START TALK UL If both users 
cUck the START TALK UI samOtaaepusly, fee host ml) ignore one of fee START TALK 
dicks such feat one user will display fee EMD TALK UI and the other will display the 

IS CONNECT UI If the sender clicks fee START TALK UI prior to the recipient 602b 

accepting fee initial text message, the recipient 602b does not display the START TALK UI 
bat instead immediately displays fee CONNECT Ul 

In one implementation, a talk tool establishes an active talk session using three 
communication channels: a Generic Signaling Interface (GSI) channel, a control channel, and 

20 aa audio channel. The talk too! uses fee GSX channel to establish the initial connection. 
During; this connection, the local W addresses are exchanged. After fee initial connection 
phase is done, the GSS channel is no longer used. By using fee OS* channel fee exchange of 
local B 5 addresses is only done when both users permit such an exchange, i ,'«,» by clicking on 
the CONNECT UL These actions protect users from having feeir local IP addresses 

as aidoxnaticaUy obtained without feeir consent 

The control channel k a TCP/IP socket, for which fee IP address and port number of 
fee remote side am obtained through the GSI channel. The control channel is used to 
send/receive control attributes of the talk session while fee session is active. For example, 
because some firewalls will not allow an external connection to a socket on fee inside of the 

m firewall, fee talk tool attempts a connection from both sides of fee session. His action allows 
a connection to be saads if there is a maximum of one firewall within fee connection. If there 


-19- 


wo mm®m 


fcmmimm 


The talk tool also may allow the user to control the volume for the speaker and 
aucrophone, la one Lmplemsrrtafion, the user speaks into a microphone and the audio data 
are recorded into memory. While in the record mode, the average level of the speaker's voice 
is indicated on a level meter displayed on a user interface of fee talk tool, A slider control is 
s used to adjust the input level to as optimal value. After the speaker stops speaking, the 
speaker's stored speech is played back through the computer's audio output device. The 
speaker level slider control may be used to adjust fee output level to an acceptable volume. 
If the user starts to speak, again, the talk tool reverts to the record mode and the cycle repeats. 
Once- fee user is satisfied with fee settings, the user can save fee settings for use is 

the talk tool may support additional tunctionality heading, but sot limited to, multi- 
coarereackg, hold, and muting. Midti--oom%fencmg allows more than two users to engage k 
a talk session. Hold allows the suspeoskm of an active talk session in order to connect to 
another talk session Muting tarns otfthe microphone to prevent user feedback/echo during 

is M duplex inode, 

The talk tool also may Include security features to protect die integrity of transferred 
data. For example, the talk tool rosy compress data using a proprietary algorithm or may 
send fee data la a proprietary protocol. To further improve security, fee talk tool may select 
the port numbers at random txom a large range, 

20 In general, m instant messaging talk session is similar to a telephonic session in that 

it has the same tfexee states; not connected (hung up), coaaecUng (ringing), and connected 
(talking). As described above, these states sad the ability to switch among fern am 
supported by corresponding UXs, namely a START TALK U£ (not connected), a CONNECT 
Ul (ringing), and an END TALK W (connected). 

2S Fig. 7 illustrates one example of a START TALK Ul As shows is Fig, 7, a START 

Vi 700 includes an instant message box 70S having a START TALK button. 71 0 lor 
requesting a talk session, 

Fig, S Illustrates one example of a CONNECT UX As shown in Pig. 8, a Ul 800 
includes an instant message box SOS having a CONNECT button 810 for accepting & request 

30 to mitiaie a talk session. 


Fig. 9 illustrates one example of an END TALK UJL As shorn* m Fig. 9, a 01 900 
includes an instant message box 905 having END TALK bu«»a 910 for tarm&ati&g a talk 

Fig. 10 Uiusteai® one *xam P le of a half duplex user inisdkce. As sbowa in Fig, 10, a 
IJl 1000 racludes an instant message box 1005 having a TALK batmn 10J 0. The bottom 
1010 is greyed out or otherwi&e disabled ^es the other party is talking. 

Other embodaneots ass within tha scope of the following ciaims. 


WHAT IS CLAIMED IS: 

1 . A eornrnmsic&tioris method coraprissng; 

enabling instant messaging coamaucatioa between & sender and at least one 

recipient through, m instant messaging host; and 

enabling voice communkato between the sender and fee recdpieat through the 
messaging Ixhl 


2. The sse&oil of claim 1 ffcrSasr comprising receiving and auff ienficatisg a teact instant 
message from fee sender at the instant messagpsg host 

3. The method of claim 2 v&ereui aufeesheaiing fee text instant message comprises 
kfe»ii$iag a scremname associated with at. least one of the sender md fee recipient 

4. The mefeod of claim 2 wherein asahsalacafog the test insiam message coraprises 
identifying an S> address associated with at least one of the sender and the recipient 

5. The method of claim I fcrtaer eornprismg defenmrdng capabilities of the recipient at the 
instant messaging host 

6> The method of claim 5 -wherein determining capabilities comprises identifying hardware, 
associated with fee recipient 

7. The ms&od of claim 5 wherein determining capabilities comprises identifying software 
associated with the recipient. 

8. The method of claim 5 farther comprising reporting the capabilities of the recipient to the 


9. The method of claim g wherein fee sender displays a 
capabilities of fee recipient. 


interface according to the 
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10, The method of claim 1 further comprising receiving, at the instant mess 
reqtsest to establish voice eommimie&tion, 

1.1 . The me&od of daks 10 wherem fee request is from the sender. 

12, The method of claim 10 wherein the request is .from fee recipient 

13. The method of claim 10 former comprising autheracatiag the request 


14. The method of claim 11 wherein aufeeaticatbg fee request comprises 
a screen name associated with at least one of the sender and the recipient 


15, The xaethod of claim 11 wher&in autfasotios&ag the request comprises kleatrfyiag 
aa ff* address associated with at. least one of the sender aad the recipient 

16, The method of claim 1 wfasrek enabling voice commaaxcatioxi coa^rises establishing a 


ihod of claim 16 fer&er eomprismg attempting a mods UDP test on the audio 

1 S, The method of claim 1 6 wherein fee control chaanei comprises a TCP/IP socket 
.1 9, The method of claim 16 wherein the audio channel comprises a UDP channel. 
20, The method of claim 16 wherein trie audio channel comprises a TCP channel. 

2L Ac 
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1 22, A cosiputer program, stored oa a computer readable 


1 24, The 



25. The computer ptogr^ of claim 22 wtam the- oooaputar readable medium h a host 


26. The compute program of «&ira 22 wherda the c 


-as- 



SUBSTITUTE SHEET (RULE 28} 



SUBSTITUTE SHEET (RULE 26) 


WO SlftMW 



SUBSTITUTE SHEET (RULE 2§) 



f/l 



SUBSTITUTE SHEET (RULE' 28) 



wo mmm 



i 




®»stAot m mm mm m hour m sh mom 

# NOTIFY AOL 


FNL7 


TALOBTH1:D 


1 


noiKiii osio n mum 


2 CsD 


r 81Q 


I 


mi 


^CONNECT 

# GETPRC^tE 

# NOTIFY AOL 


SUBSTITUTE; SH6ET {RULE 2*) 


@ SET PROFILE 
# NOTIFY AOL 


¥ m 


mi 


r 


mm 


# GET PROFILE 
J @ NOTIFY ACL 


m W 


SUBSTITUTE SHEET (RULE 26) 


